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Abstract 

We define and analyze an inductive reasoning game of voluntary yearly vaccination in order to estab- 
lish whether or not a population of individuals acting in their own self-interest would be able to prevent 
influenza epidemics. We find that epidemics are rarely prevented. We also find that severe epidemics 
may occur without the introduction of pandemic strains. We further address the situation where market 
incentives are introduced to help ameliorating epidemics. Surprisingly, we find that vaccinating families 
exacerbates epidemics. However, a public health program requesting prepayment of vaccinations may 
significantly ameliorate influenza epidemics. 



Game theory has been very successful to help design economic market strategies. Recently, game theory 
has been applied in the field of theoretical epidemiology. Deductive reasoning games have been used to price 
vaccines and to predict the voluntary vaccination coverage (i.e., the proportion of the population that 
gets vaccinated) for pathogens that provide permanent immunity (smallpox and measles) [13 Ej- However, 
applying deductive reasoning may be limited [3] because it requires that individuals share the same perception 
of risk of infection and vaccination adverse effects. For pathogens that provide permanent immunity, using 
deductive reasoning games is still justified since individuals need to get vaccinated only once. However, in 
the case of pathogens that do not provide permanent immunity (e.g., influenza), individuals need to make 
vaccination decisions every year. It may be assumed that individuals make vaccination decisions based 
on their past experiences (i.e., use inductive reasoning) rather than based only on the current influenza 
epidemiology (i.e., use deductive reasoning). Here we present and analyze for the first time several inductive 
reasoning games that may apply to influenza vaccination. 

The first inductive reasoning model was introduced in 1994 with the El Farol bar problem 3 . We now 
briefly present this problem as a paradigm for inductive reasoning games. Consider a group of N individuals 
acting in their own self-interest. Each week, every individual independently decides whether or not to go to 
the El Farol bar. An individual deems it worth going if fewer than a critical fraction of the total number of 
individuals N are present. Otherwise, the bar is crowded and the individual would rather stay at home. No 
individual knows the bar attendance in advance, nor do they communicate with others; thus, the decision of 
going to the bar cannot be made in a logical deductive fashion. Instead, an individual would predict /guess 
the bar attendance and base their decisions on these predictions. Once the bar attendance is known, an 
individual evaluates and adapts their predictions for future decisions. This continuous adaptation of one's 
behavior based on expectations about future collective behavior is called inductive reasoning and applies 
in many instances where logical deductive reasoning fails either in principle or due to bounded rationality 
[2| ■ Inductive reasoning games have been applied to financial markets where traders decide to buy or sell a 
certain asset whose price is determined by their collective action [81 1221 l9l I7j . For example, in a market with 
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more buyers than sellers it is rewarding to be in the minority of sellers to benefit from a higher price of the 
asset. Such games have been called Minority Games [81122113117). 

We note that there are striking similarities between the El Farol bar problem and the dynamics of the 
market of voluntary vaccination against pathogens that do not induce permanent immunity. For concreteness 
of discussion, we consider influenza vaccination. The influenza vaccine is effective for one year only, thus 
individuals must decide every year whether to vaccinate or not |25| . It may be assumed that individuals 
act in their own self-interest trying to avoid infection preferably without having to vaccinate. The yearly 
vaccination coverage (i.e., the proportion of the population vaccinated each year) is determined by the 
collective participation of the individuals. Compartmental models of disease transmission ^J^JEl have 
shown that there exists a critical coverage level such that: if the coverage is below the critical level, an 
epidemic will occur, otherwise epidemics will be prevented. However, whether or not a vaccination coverage 
larger than the critical level is likely to be reached every year in a voluntary vaccination market is a question 
that we address here for the first time. Indeed, inductive reasoning games provide a very suitable modeling 
background for approaching this question. We construct a inductive reasoning game of influenza vaccination 
based on the analogy between the situation at hand and the El Farol bar problem. The critical vaccination 
coverage will play the role of the critical attendance fraction (i.e., crowding threshold) . Individuals that go 
to the bar correspond to individuals that vaccinate. Individuals that stay at home correspond to individuals 
that do not vaccinate. For the bar problem: individuals would go to the bar for entertainment, but if the 
bar is crowded, they would rather stay at home. For the vaccination game: individuals would vaccinate to 
avoid infection, but if the coverage is larger than the critical level, they no longer need to vaccinate to avoid 
infection. However, there are also distinctions between the two games. When an individual does not vaccinate 
and the critical coverage is not reached, they still have a non-zero probability of avoiding infection due to 
peer vaccination (i.e., they are protected by herd immunity). In contrast, for the bar problem, an individual 
always regrets not going to the bar if the critical attendance is not reached. We construct an individual-level 
model that describes the adaptive dynamics of vaccination decisions in a population of non-communicating 
individuals acting in their own self-interest (i.e., selfish). Our model tracks both individual- level vaccination 
decisions and behavior as well as the resulting population-level variables such as influenza prevalence and 
vaccination coverage levels. 

From the public health point of view, our work has important consequences |27| . In the United States, 
influenza vaccination is voluntary and the demand for influenza vaccines (70 to 75 million vaccine doses per 
season) is generally met. The vaccine is very effective in offering protection 6 . However, due to evolution 
of the virus and waning immunity, the vaccine is good only for one influenza season. In recent years, the 
vaccination coverage has steadily increased ^3 El- Even so, every year, up to 25% of the United States 
population is infected with influenza causing 36,000 deaths |2J|2S|- O ne of the national health objectives 
of the United States is to further increase the vaccination coverage [2] which currently is below the 
Healthy People 2010 objective |19|. Therefore, it is important to understand the vaccination dynamics and 
what incentives could be used to increase the vaccination coverage in order to control the epidemic. 

The outline of the paper is as follows. In sections \I\we introduce and briefly analyze our individual- level 
vaccination model with no public health program (basic model). Our strategy is to derive a dynamical system 
for the expectations of the variables of the model. Then, we address deviations from this mean-field limit 
by adding small gaussian noise to the dynamical systems. Using the same approach, in section[5]we discuss 
analytical results regarding the basic model with superimposed vaccination incentives which results into two 
public health programs. Our analysis helps explain the coverage dynamics observed in direct numerical 
simulations of the model. 
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1 Basic Model 



1.1 Description 

Deterministic models of disease transmission based on ordinary differential equations [151111)1 IT7| have shown 
that there exists a critical coverage level such that: if the coverage is below the critical level, an epidemic 
will occur, otherwise epidemics will be prevented. Our inductive games include a simple model of this 
coverage threshold 1 . We denote the coverage by P, the critical coverage by p c , and the probability of getting 
infected by q. We consider that if P < p c , then q(P) decreases linearly with P, otherwise q(P) = 0. This 
model is consistent with the fact that unvaccinated individuals benefit from herd immunity. Also, it is in 
qualitative agreement with more sophisticated results from the analysis of the Susceptible-Infected- Recoved 
(SIR) model; see Appendix lA"f. The qualitative nature of the results that we describe in this article does not 
depend on the details of q{P). They only depend on the fact that q{P) is strictly monotonically decreasing 
for P < p c and for P >p c . We now present the assumptions that define our first inductive reasoning game 
which we refer to as the basic model. 

1. We consider a number N of individuals that every year make vaccination decisions. They are assumed 
to act in their own interest and not to communicate their decisions to each other. The sole interest of 
the individuals is to avoid getting infected, preferably without getting vaccinated. 

2. To make their vaccination decisions, each individual uses their past experiences of vaccination outcomes. 
Thus, individuals independently decide whether or not to vaccinate using inductive reasoning. 

3. An individual remembers and weights their previous vaccination outcomes with respect to their present 
vaccination outcome. A parameter s discounts the previous year vaccination outcome with respect to 
the outcome of the present year (0 < s < 1). For s = 0, individuals completely ignore the outcome of 
previous seasons and, as a consequence, do not use inductive reasoning. If s were equal to 1, individuals 
would not discount the previous vaccination seasons; therefore, the vaccination outcome of the present 
season is as important as any of the previous seasons. 

4. We define a vaccination decision as a Bernoulli variable Xn with parameter Wn that depends on 
a variable Vn \ i and n are positive integers; i = 1,2, ...,N labels the individual and n > labels 
the seasons. If individual i decided to get vaccinated in season n then x„ = 1, otherwise Xn = 0. 
Wn* is the probability that individual i vaccinates in season n. The variable Vn^ characterizes the 
pro- vaccination experience of the ith individual (see details in assumption (7)) and determines w$ ■ 
The domains of the variables are as follow: Xn 

E {0, 1}, w { : ] e [0, 1], and 14 (l) € [0, 1/(1 - a)). 

■5. In year n, a set X n of N vaccination decisions is made: X n = {x^;l < i < N}. Our inductive 
reasoning game is an array (X n ) where {x« } , 1 < i < N} determine {V^i, 1 < * < N } which further 
determine {w„.L; 1 < i < N}, the parameters of the Bernoulli variables {xi+n 1 < * < N} in year 
(n + 1). 

6. The infection event of individual i in year n is a Bernoulli variable r)$ with parameter q(P n ), where 
P n = Y)^-y Xn /X is the coverage achieved that year. If individual i got infected in season n then 
rjn — 1, otherwise ry„ = 0. 

1 We do not include the option of treatment. However, the effects of treatment can be implicitly included in our model by 
decreasing the effective critical vaccination coverage p c . 

2 Our model is designed to describe a large population of selfish non-communicative individuals. Thus, we account only for 
the occurrence of epidemics and we do not consider outbreaks. Outbreaks become decreasingly important as the population 
size N increases. 
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7. X n = {xn 1 ] 1 < i < -^V} and {r/i^; 1 < i < iV} determine as follows (see Fig. [TJ. We have four 
cases: (al) if Xn — 1 and p c < P n , then = sVn , that is, if individual i gets vaccinated in 
season n and no epidemic occurs, then the individual considers the vaccination unnecessary; (a2) if 

(i) (i) (i) 

Xn = 1 and P n < Pc, then V^/ 1 = sVn + 1; which means that if individual i vaccinates in season n 
and an epidemic occurs, then the individual considers the vaccination necessary; (bl) if = and 
rjn — 1 then V^Vj = sVn + 1: that is, if individual i does not get vaccinated in season n and gets 
infected, then the individual considers the vaccination necessary; and (b2) if X n ] = and r$ = then 
= sVJP; which means that if individual i get vaccinated in season n and they do not get infected, 
then the individual considers the vaccination unnecessary. 

8. The probability that an individual chooses to get vaccinated is updated as follows 

^2-1=^1 -!)/(*-!)]. (1) 

That is, an individual's probability to get vaccinated in the next season is given by the updated 
cumulative vaccination experience. We have normalized by (s™ +1 — l)/(s — 1) because this factor 
is the maximum possible value for \ if individual i would have benefited from vaccination in all of 
the n influenza seasons. 

We consider initial conditions that assign a random vaccination probability for the first season to every 
individual. Specifically, Vq = and is uniformly random between and 1. Our initial conditions 
are chosen to reflect the fact that the initial public awareness of the benefits of the influenza vaccination 
is not high enough to prevent an epidemic, while at the individual-level the likelihood of vaccination may 
vary considerably. Figure |21 shows numerics obtained by simulating the basic model. Our analysis aims to 
provide an understanding of the coverage dynamics in Fig. [21 As p approaches p c from below, it eventually 
fluctuates above p c , then abruptly drops below p c , and the dynamics repeats. 



1.2 Analysis 



We first present an analysis of our featured model in the limit of large population. Then, we discuss 
asymptotic aspects of the model that apply as the population is large, yet finite. We proceed with the 
derivation of a one-dimensional iterated map in the variable p denoting the average of u>W over the entire 



population. Note that w { n } = E(x { n ] ), p n = E{P n ) = E^w^/N, and E(q(P)) = q(p) where by EQ we 
denote expectation. Following the tree in Fig. ^which describes the four cases of vaccination evaluation, we 
obtain 



branch 


expected population fraction 


update 


(al,2) 


Pn 


V^^sV^ + l-e(p n -p c ); 


(bl) 


(l-p n )q(pn) 


y(i) _ y(0 , 1. 


(b2) 


(1 -p„)[l - q{pn)} 


v n+l — sy n , 



(2) 



where 9{x) is the unit step function defined as 



1, if.T>0; 
0, if x < 0; 



6{x) = 

and q(p), the probability of an unvaccinated individual getting infected with influenza is given by 

q(p) = 



0, if p > p c 

-pq(0)/p c + q(0), if p<p c 



(3) 



(4) 
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Taking the weighted average over Eqs. we obtain 



V n+1 = SV n + (1 -p n )q(Pn) + Pn[l ~ #(Pn "Pc)], (5) 

where u denotes the average of yw over the entire population. Taking the population average over Eqs. l(TJl. 
we get 

p n+1 = (l-s)v n+1 /(l-s n+1 ). (6) 

Combining Eqs. JSJ and ©, we describe the dynamics of the vaccination coverage at the population level in 
the limit of infinite population, without regards to the individual-level processes 

s (l _ s «) 1 — s 

Pn+1 = 1 _ s n+l P" + I _ ~P")g(Pn) +Pn[l ~ ~ Pc)]}- (7) 

Our dynamical system is defined on the unit interval X = [0, 1]. 
1.2.1 Fixed Point Analysis 

The fixed points of our map are determined by the following autonomous asymptotic form obtained from 
Eq. 10 as n — > oo 

p„+l = Sp n + (1 - S){(1 -p n )q{p n ) + Pn[l - #(Pn ~ Pc)]}- (8) 

Due to the discontinuities at p = p c , we distinguish two complementary domains: X\ — \p c , 1] and X 2 = [0, p c ). 
Case 1: Xi. Equation (JHJ becomes the following linear dynamical system 

p n+ i = sp n . (9) 

The above dynamical system has no attractors in X±. However, if we extend the domain to X, then the 
system has a fixed point at p* — which is a global attractor that belongs to 2"2- This fully characterizes 
the dynamics in X\ : orbits in X\ will be attracted to until they land in Xi . In X2 the orbit is iterated with 
a different smooth map. 

Case 2: X?,. We now obtain the following nonlinear dynamical system 

Pn+i =Pn + (l-s){l-p n )(-p n q{0)/ Pc + q(0)), (10) 

that has no fixed points in Xi- However, if we extend the domain to X, then the system has two fixed points: 
p = 1 and p = p c . The derivative of the map evaluated at p is 1 + <?(0)(1 — s)(p^ 1 — 1) > 1; thus, this fixed 
point is unstable for all the parameter values, p is a potential attractor of the system since the derivative 
of the map evaluated at p is 1 — <?(0)(1 — s)(p ( 7 1 — 1) with range (— 00, 1]. It is important to note that p 
lies on the boundary between X\ and X 2 . Thus, even though p does not belong to X 2 , p attracts orbits with 
initial conditions in X 2 . That is, the basin of attraction of p intersects X 2 . Assuming that p is an attractor 
and derivative of the map at p is nonnegative, orbits that start in X 2 are immediately attracted from below 
to p, but never reach this fixed point. They only get arbitrarily close to it, always remaining in X 2 . Orbits 
that start in X\ are initially attracted to p* = but once they land in X 2 they are attracted to p. For 
the parameters of the numerics presented in Fig. [2 p is an attractor and the derivative of the map at p is 
nonnegative. 



5 



1.2.2 Bifurcation Diagram 



With varying p c and/or s and/or q(0), a rich dynamical behavior is observed for our iterated map. As 
expected in piecewise smooth systems, we observe border- collision bifurcations [231 111! IT"!! 1201 HH1 1131 112| . A 
bifurcation diagram for s = 0.7, q(0) = 0.8 and varying p c is presented in Fig. |3J With decreasing p c , the 
derivative of the map at p, 1 — (1 — s)[q(Q)(j)~ 1 — 1)], becomes zero at p c = {1 + 1/[(1 — s)q(O)]} -1 ~ 0.2. At 
this critical p c value, a border collision bifurcation takes place and a stable periodic orbit is created in phase 
space. Approaching p for p c < {1 + 1/[(1 — s)q(0)]}~ 1 , an orbit in I2 will land in X\ since the derivative of 
the map at p is negative. The smooth map that applies to the X\ domain [Eq. @] will send the orbit back 
in X2, and, eventually, a stable period two orbit is created. With further decreasing p c , p becomes unstable 
at p c = {1 + 2/[(l — s)g(O)]} -1 w 0.1 and the period two orbit undergoes period doubling. At low values of 
Pc chaotic behavior is numerically observed. 



1.2.3 Effects at Large Finite N 

We now discuss several aspects of the dynamics that occur because the number of individuals N is in fact 
finite, albeit large. These aspects are transparent in our direct simulations of the game and the above fixed 
point analysis is insufficient to explain the results in Fig. [21 

From the point of view of the mean field analysis, the case of large finite N can be described by adding 
small amplitude gaussian noise to the mean field map. In most of the phase space the noise does not change 
the qualitative dynamics of the orbit. However, the situation becomes critically different as the noisy orbit 
asymptotically approaches p from I2. Due to the noise (i.e., stochasticity in the mean field due to the finite 
number of individuals), p may jump above (but close to) p. According to Eq. @, in the next iteration the 
orbit lands in I2 in the vicinity of sp Cl far from p = p c ; see Fig. [5] Then, the orbit is attracted again to 
p and undergoes a similar scenario in an apparently periodic dynamics. This phenomenon may be called 
noise induced border- collision bifurcation since the presence of arbitrarily small noise transforms an orbit 
asymptotically approaching p into an orbit that is expected to be periodic. We note that this sensitivity of 
the mean field of the basic model to arbitrary small noise makes the simulation of the mean field of the basic 
model difficult since rounding noise cannot be avoided in numerics. 

The expected periodicity depends on the number of individuals in the ensemble and can be estimated as 
follows. Close to p, the dynamics of p can be approximated as p — p n ~ A", where A is the derivative of the 
map at p; for the parameter values used in Fig.|21 A = 1 — (1 — s)[q(0)(p^ 1 — 1)] f» 0.84. Denoting iVJJ and N 
the numbers of individuals that vaccinate in season n and the number of individuals that would vaccinate 
at equilibrium, the previous relation can be written as N — N% ~ X n N. We expect a jump of the coverage p 
above p when N — ~ N 1 / 2 which is the order of the fluctuations in N%. Denoting h the expected period 
of the dynamics, we obtain the following scaling result at large finite 

log(A^) 

2 log A V ' 

which we have successfully verified through numerics (not shown). 



2 Models with Public Health Programs 

The basic model predicts that epidemics are not prevented. Furthermore, severe epidemics are periodically 
expected. We explore two possible public health strategies that may ameliorate epidemics. Thus, we intro- 
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duce two additional inductive reasoning games in order to evaluate the potential effects of the following two 
public health programs applied to the basic model: 

• Program 1: If the head of the family (HF) pays to get vaccinated then their family will get vaccinated 
for free. 

• Program 2: If an individual pays to get vaccinated then that individual will get free vaccinations for 
a specified number of successive years. 

We follow our previous strategy, deriving and analyzing mean-field approximations. Then, we discuss first 
order deviations from the mean-field exploring the effects of superimposed small noise. 

2.1 Public Health Program 1 
2.1.1 Model Description 

We consider that the population of N individuals is now divided into F groups representing families. Each 
family contains C members and one individual in each family acts as its head. The public health program 
offers free vaccination to a family if the head of that family paid for his/her vaccination. Only the heads 
of the family make vaccination decisions and they track the vaccination experience for all of their family 
members; see Fig.0] It is very important to note that, as a consequence of this public health program, the 
vaccination coverage of the heads of families equals the population-level vaccination coverage. We specify 
the model using a set of eight assumptions. 

1. We consider a number of F = N/C HF that every year make vaccination decisions. They are assumed 
to act in the interest of their own families (including themselves) and not to communicate their decisions 
to each other. The sole interest of the HF is to protect their family members from infection, preferably 
without getting anyone vaccinated. 

2. To make their vaccination decisions, each HF uses inductive reasoning. 

3. A parameter s discounts the HF's previous year vaccination outcome with respect to the outcome of 
the present year (0 < s < 1). 

4. A vaccination decision is a Bernoulli variable Xn with parameter that depends on a variable Vn l K 
i and n are positive integers; i — 1, 2, F labels the HF and n > labels the seasons. If HF i decided 
to vaccinate in season n then their family also gets vaccinated and Xn — 1; otherwise, Xn = 0. 
w^n is the probability that HF i vaccinates in season n. V„ (i) is the pro-vaccination experience of the 
family of HF i (see assumption (7)) and determines Wn\ The domains of the variables are as follow: 
X$ € {0, 1}, w { : ] e [0, 1], and VJP e [0, C/(l - a)). 

5. In year n, a set X n of F vaccination decisions is made: X n — {xn^l < i < F}. Our inductive 
reasoning game is an array (X n ) where {xn\ 1 < i < F} determine 1 < i < F} which further 
determine {w^ +1 ; 1 < i < F}, the parameters of the Bernoulli variables {Xn+i; 1 < * < F} hi year 
(n+1). 

6. The infection event of individual j (j — 1,...,N; i.e., the individual may or may not be HF) in year 
n is a Bernoulli variable rjn^ with parameter q(P n ), where P n = J2f=i Xn /F is the coverage achieved 
that year. If individual j got infected in season n then r)„ ' = 1, otherwise, r\n = 0. 
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7. X n = {xl l) ; 1 < i < F} and {r/<?; 1 < i < F} determine as follows (see Fig.Q}. We have C + 3 
cases: (al) if Xn = 1 and Pc < then V„i = sVn; that is, if HF i gets their family (including 
themselves) vaccinated in season n and no epidemic occurs, then the HF considers the vaccination 
unnecessary; (a2) if Xn = 1 and P n < p c , then V^+i = sV^ + C; which means that if HF % gets their 
family (including themselves) vaccinated in season n and an epidemic occurs, then the HF considers the 
vaccination necessary for all the family members; (bk) if x„ — and k family members (fc = 0, C) 
have r]n^ = 1 (where ji = 0, C labels the family members of the ith family), then V^li = sVn + fc; 
that is, if HF i does not get vaccinated in season n and k members of their family (including themselves) 
get infected, then the HF adjusts his pro- vaccination experience by accounting for their infected family 
members. 

8. The probability that an HF chooses to vaccinate is updated as follows 

^Si = V^i/[C(s n+1 - l)/(s-l)}. (12) 

That is, an HF's probability to get vaccinated in the next season is given by updated cumulative 
vaccination experience. We have normalized by C(s n+1 — l)/(s — 1) because this factor is the 

maximum possible value for if HF i and their family would have benefited from vaccination in 

all of the n influenza seasons. 

Figure shows numerics obtained by simulating the model with the first public health program. We note 
that the coverage drops below p c more often, and thus the first public health program appears detrimental to 
ameliorating epidemics. Our analysis aims to provide an understanding of the coverage dynamics in Fig. [5j\. 



2.1.2 Model Analysis 

Following the HF evaluation tree shown in Fig. 0] we obtain 



branch 


expected population fraction 


V {i) update 


(al,2) 
(bk) 


Pn 

(1 - Pn)Qk(Pn) 


V W i=sV W + C [l-e(p n -p c )}; 
V^^sV^+k- 



where Qk(p) is the probability that k members get infected with influenza in an unvaccinated family when 
the expected coverage is p. The probability that a single individual gets infected in a season with expected 
coverage p is q{p). Assuming mass-action infection dynamics |21| . the probability that k members of a family 
get infected is binomial 

QuiPn) = kl{ cL k y ^ k t 1 - ^ C ~ k ■ ( 14 ) 

We now present mean-field equations for our model with the first public health program. Substituting 
Eq. Ijl4(l into Eq. (|13|l and averaging over all branches we obtain 

V n+ i = SV n + Cp n [l - 9(p n -p c )] + Cq(p n )(l -p„). (15) 

Averaging over Eq. I|12|l we obtain 

P„+i-^+i/[C( S " +1 -l)/( S -l)]. (16) 

The fixed point analysis of the above dynamical system follows similarly to that of the basic model 
and yields similar results. As in the case of the basic model, p = p c plays a crucial role in determining 
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the dynamics. The derivative of the coverage map at p is the same as in the basic model. The expected 
periodicity formula is similar to that found for the basic model [Eq. i|llf) ]. In this case the number of 
HF (F = N/C) determines the periodicity instead of the total number of individuals (N). Therefore, the 
periodicity as a function of the family size C can be expressed as 



h(C) 



log(-FPc) 
21ogA ' 



(17) 



where for C = 1 we recover Eq. We now compare the expected periodicity of major epidemics for 

C > 1 to that for C = 1 (i.e., basic model). We use the same values of s, p c and q(0) such that orbits in 
both models approach p from X\ . The ratio of the expected periodicities is given by 



h(C)/n(l) 



1 



logC 



log(Ap c ) 



< 1. 



(18) 



Hence, the first public health program increases the frequency of major influenza epidemics and decreases 
the time average of the coverage. 



2.2 Public Health Program 2 
2.2.1 Model Description 

An individual who pays to enter the second public health program receives influenza vaccination for the 
current year and for y number of successive years. Although individuals enrolled in the program do not 
make vaccination decisions, they consider the necessity of vaccination every year. At the end of the free 
vaccination period, they use their evaluations to decide whether to pay for another enrollment. The model 
can be formally described by a number of eight assumptions. In particular, we use assumptions (1) through 
(7) of the basic model. Assumption (8) is the following. 

(8) The probability that an individual gets vaccinated is updated as 

^ii = ^i/[( S " +1 -l)/( S -l)], (19) 

unless Xn = 1; i-e., the individual vaccinated in season n. In this later case, w!£l_ r = 1 for < r < y, 
and, in season (n + y + 1), 

= v r [% +1 /[( s n+ y +1 - 1)/(* - 1)]. (20) 

That is, after vaccinating in season n, and taking advantage of y seasons of free vaccination, the 
individual resumes his adaptive behavior in season (n + y + 1 ) . 

Figure [SJ3 shows numerics obtained by simulating the model with the second public health program. We 
note a qualitative change in the orbit of p; thus, the second public health program can potentially ameliorate 
epidemics. Our analysis aims to provide an understanding of the coverage dynamics in Fig. 



2.2.2 Model Analysis 

We now introduce notation to describe the analysis of the model. We use the superscript r to specify the 
individual-level parameters for individuals that have r vaccinations left. (0 < r < y) denotes the number 
of individuals that have r vaccination years left in season n; X)r=o = N. The ratio between the number 
of individuals with r vaccination years that vaccinate in season n and 2V£ is denoted by 7r^. Since we assume 
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that all individuals complete the free vaccination program, 7r^ = 1 if r > 0. The population-level coverage 
can be written as 



(21) 



Given ir n we can write a dynamical system for iVj 

Iv n+1 

N r 

Jv n+1 



Jv n+1 



AT* + (1 - 7T°)iV°, 

7V; +1 ; for < r < y, 
ir°N° 



(22) 



The number of individuals that will decide to enroll in the program next year (N® +1 ) is given by the 
individuals that will finish their vaccination program (iV„) and the individuals that did not enroll in the 
vaccination program this year ((1 — 7r„)iV„). The number of individuals with r (0 < r < y) years left in the 
program next year (N^ +1 ) is given by the number of individuals with r + 1 years left in the program this 
year. The number of individuals with y years left in the program next year (iV^ +1 ) is given by the number 
of individuals that enroll in the vaccination program this year (ir^N®). 

The vaccination behavior of the individuals enrolled in the vaccination program is simple: they vaccinate 
every year 



•CO = i 



(23) 



However, they evaluate the necessity of vaccination updating their pro-vaccination variable V depending on 
whether or not there was an influenza epidemic each year 



v r Jl = sv^ + i-e(p n - Pc ). 



(24) 



The individuals that are not enrolled in the vaccination program need to decide whether or not to vaccinate. 
The individual-level probabilities to vaccinate get updated as in the basic model 



0(i) 
:J n+l = 



F„°«/[( S " +1 



!)/(*-!)]. 



(25) 



The evaluation of the vaccination decisions is the same as in the basic model; see Fig. ^ Following the 
evaluation tree in Fig. \I]we obtain 



branch 


population fraction 


y « 


update 


(al,2) 




t/O [i) 
v n+l 


= aVX w + l-6(p n -Pc)\ 


(bl) 


(1 - 7r°)g(p„) 


v n+l 


= bV*W + 1; 


(b2) 


(l-4)(l-g(p„)) 


T/ 0(i) 
v n+l 





(26) 



We now present mean-field equations for our model with the second public health program. Dividing 
Eqs. I|23|) by N we get a set of equations for 77^ = N^/N which are intensive quantities. Following the 
technique in Sec. we average over the individuals to obtain the mean-field variables. We arrive to the 
following dynamical system 



T 

Vn+l 



= ri r n +1 ; for < r < y, 



y 

Vn+l 



(27) 
(28) 
(29) 
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' J n+1 



u n+l 



SV° n + (1 - n° n )q(p n ) + tt" [1 - 9(p n - p c )}, 
sv r n + 1 - 9(p n - p c ); for < r < y, 



(30) 
(31) 



where 



'n+1 



'n+1 



= (i- s K +1 /(i- s " +1 ), 

= 1; for < r < y, 



Er r 

r=0 



(32) 
(33) 



(34) 



and 



(35) 



r=0 



The dynamical system simplifies since the equations for v r (0 < r < y) and 7r r (0 < r < y) are decoupled, 
and 77° can be eliminated using the constraint (|35() . We thus obtain 



for < r < y, 



y 



J n+1 



1 



1 - s ' n 



1 - w° 



r=l 
1 - S 
1 - S n 



where 



Pn = F(r,l...,r,yy n ) = v° n 



1 - s 
1 - s" 



1 ~w u 



1 - s 

1 - s n 



1-s 
1 - s" 



[1 - 0(p„ -p c 



(36) 
(37) 

(38) 
(39) 



We write the state of the system as (77^, ...,77^,7;°); the domain of the dynamical system is V = [0, l] y x 

[0,1/(1-*)). 

Fixed Point Analysis. Due to the discontinuities at p — p c , we distinguish two complementary domains: 
V x = {( 7? \ ...,^,«°)|F(7 ? 1 , 7?»,i; ) > Pc } and P 2 = {(77 1 , rf, v°)\F(r, 1 , , u°) < p c }. 
Case 1: X>i. In the limit n — > 00, Eqs. (|36|l . (|37ll and l|38[) become 



^71+ 1 



"n+1 



r/ r n +1 ; for < r < y, 



(40) 
(41) 
(42) 



which has no attractors in T>\. However, if we extend the domain to T>, then the system has a fixed point 
that belongs to T>2 at x* = (0, ...,0). This fixed point is an attractor since the jacobian of the dynamical 
system evaluated at x* has one eigenvalue equal to s (0 < s < 1) and j eigenvalues equal to 0. This 
attractor is global since vq is decreasing, corresponds to the situation where no individual vaccinates, and 
fully characterizes the dynamics in T>\: orbits in T>\ will be attracted to x* until they land in T>2- In ^2, the 
orbit is iterated with a different smooth map. 
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Case 2: T>2- We now obtain the following dynamical system 

Vn+i = for < r < y, (43) 

= ^(l-^fl-E^V (44) 

< +1 = < + (45) 

that has no fixed points in XV However, if we extend the domain to T>, then the system has two fixed points. 
The first fixed point is x = ((y + 1) — 1 , (y + l) -1 , (j/ + (1 — s ) _1 ) an d corresponds to the situation 
where everybody vaccinates (i.e., p = 1). It can be shown straightforwardly that 1 + q(0)(l — s)(p^ 1 — 1) 
and 1 are eigenvalues of the jacobian of the system at x; thus, x is unstable. The second fixed point of the 
extended system is x = (p c /(y + l),p c /(y + 1), ...,p e /(y + l),p c /(l - s)/[l + y{l - p c )]) corresponding to 
p = p c - The fixed point may be interpreted as follows. The population of iV individuals is divided into two 
groups. The individuals in the first group never vaccinate while those in the second group always vaccinate. 
The number of individuals that vaccinate keep the vaccination coverage p at p c every year and always have 
positive experience with influenza vaccination. This implies that the rf (0 < r < y) values of x are all the 
same. 77 = 1 — yp c / (y + 1) includes both individuals that never vaccinate and individuals that just finished a 
vaccination program and will enroll in a new one. The individuals who do not vaccinate do not get infected 
because p = p c and always have positive experience with not vaccinating. The characteristic equation at 
x is analytically intractable. However, it can be established numerically that x is a potential attractor of 
the map defined for T>i when the domain is extended to T>. For the dynamical system describing the basic 
model with superimposed public health program 2 (Eqs. J3U), lj3*7jl . and l|H8|l). x may be attracting from Z> 2 
since x is on dT>2 and the basin of x intersects T>2] x is asymptotically approached, yet never reached. 

Bifurcation Diagram. Figure [S] presents a bifurcation diagram for y = 1, s = 0.7, q(0) = 0.8 and varying 
p c . At high values of p c , the orbits are attracted to x, which yields p — p c . With decreasing p c , a border 
collision bifurcation occurs. At a particular value of p c , a critical periodic orbit is created in phase space 
which with further decreasing p c turns into a periodic attractor (see Fig.^J). Denoting the (y+ l)-dimensional 
map given by Eqs. (|3l)|) . j57jl. and (|3"S|) by M, the equation of the critical orbit is 

MW{x;p c )=x, (46) 

where by we denoted the nth iterate of the map, and the solutions must have finite n. Equation (|4(j|) 
may be understood as follows. For some parameter values, x is reached in a finite number of iterates, x 
(x G T>\) is not a fixed point of the map M; in particular, the next iteration of x will be in V2, then the 
orbit will be evolved with the smooth map that applies in T>2 for a finite number of iterates until x is reached 
again. Equation H46J1 may not have solutions for all positive integers; also, there may be multiple solutions 
with the same value of n. In particular, for n = 4, y = 1, s = 0.7, p c = 0.6, and q(0) = 0.8, we numerically 
solve Eq. I|46|l and obtain p 1 ^ w 0.4 which is in agreement with the numerics presented in Fig. For values 
of p c in the neighborhood of p c h {p < p c h ), the critical periodic orbit turns into a periodic attractor. It is 
important to note that, except for p = p c h , the periodic attractor is bounded away from dT>2, such that the 
periodic attractor is robust to arbitrarily small noise. A similar analysis can be performed with varying s. 
To the best of our knowledge, this is the first time this type of border collision bifurcations is mentioned in 
the literature. We numerically observe that for our model, p c h and s th increase with y. 

Discussion. The study of these border collision bifurcations is critical for understanding the effect of the 
public health program 2. In practice, it would be unlikely that p c and/or s are parameters that can be easily 
changed since the critical vaccination coverage p c is strongly determined by the viral strain and the memory 
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parameter s is a feature of the population. On the other hand, y would be a parameter of the public health 
program 2 that is easy to change. Since p l c h and s th increase with y, it is expected that, for given s, p c , and 
q(0), there exists a threshold value of y (which we denote y th ) such that the orbits of the dynamical system 
with parameters y — y th — 1, s, p c , and q(0) are attracted to the corresponding x (i.e., to p = p c ) and the 
orbits of the dynamical system with parameters y = y th , s, p c , and q(0) go to a non-trivial period n attractor. 
For example, for s = 0.7, p c = 0.6, and q(0) = 0.8, we obtain y th — 3 and n — 6. This phenomenon is very 
important since it establishes a threshold value for the number of prepaid vaccinations such that the public 
health program 2 makes a significant difference in the dynamics of the mean field coverage. Furthermore, 
depending of the parameters of the system, the statistics over time of the orbit on the periodic attractor 
may yield better epidemiological quantifiers that the statistics over time of the orbit attracted to p c . In this 
case, the public health program 2 is effective in ameliorating the influenza epidemiology. 

3 Conclusions 

We introduced (for the first time) an inductive reasoning game to model whether or not the critical vaccina- 
tion coverage can be reached and influenza epidemics can be prevented by voluntary vaccination in a large 
population of individuals acting in their own self-interest. From our analysis, it obtained that epidemics 
are only occasionally prevented. We explored two public health programs based on offering incentives in 
a voluntary vaccination market. The first public health program proposed dividing the population into 
families and leaving the vaccination decisions to the heads of the family. Surprisingly, this program always 
exacerbated epidemics since it reduced the number of independent decision makers. The second public 
health program that we analysed required prepayment of vaccinations. We found that there exist a critical 
number of prepayments so that the public health program will make any difference at all for the course 
of the epidemics. Once this critical number of prepayments is established and implemented, depending on 
the population parameters and the epidemiological parameters, the second public health program has the 
potential to ameliorate epidemics. 
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Figure 1: A: A schematic diagram illustrating the evaluation tree for each selfish individual. An individual 
that decides to vaccinate (branch (a)) will judge their choice depending on whether there was an epidemic 
that season. If the coverage was equal or greater than the critical coverage p > p c (branch (al)), they will 
conclude that their choice to get vaccinated that season was not necessary to prevent infection. Otherwise, 
if the coverage was lower than the critical coverage p < p c (branch (a2)), they will conclude that their choice 
was beneficial for avoiding infection that season. An individual that decides not to vaccinate that season 
(branch (b)) will judge their choice based on whether they was infected. If they did get infected (branch (bl)) 
they will conclude that their choice of not vaccinating was detrimental and that vaccination was necessary 
for avoiding infection. Instead, if by chance they avoided infection (branch (b2)), they will conclude that 
vaccination was not necessary. 
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Figure 2: Vaccination dynamics using a memory parameter s — 0.7, a critical coverage p c — 0.6 (dashed 
line) and a probability q(Q) — 0.8 of getting infected when the coverage p = 0. Dynamics of yearly coverage 
p for a population of N — 10° individuals. The dynamics of p is approximately cyclic: as p approaches p c 
from below, it eventually fluctuates above p c and then abruptly drops below p c . 
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Figure 3: Bifurcation diagram of the dynamical system given by Eq. (JJJ versus p c . s — 0.7 and the probability 
of getting infected when the coverage p — is q(0) = 0.8. We note that numerical noise greatly perturbs the 
dynamics of our piecewise smooth map because p G dX%. To improve the numerics, we slightly modified the 
map in order for ji 6I2; in turn, this slightly changes the bifurcation values of p c . 
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Figure 4: Schematics illustrating the evaluation tree for each head of family. An head that decides to 
vaccinate themselves and their family (branch (a)) will judge their choice depending on whether there was 
an epidemic that season. If the coverage was equal or greater than the critical coverage p > p c (branch (al)), 
they will conclude that their choice to get vaccinated that season was not necessary to prevent infection. 
Otherwise, if the coverage was lower than the critical coverage p < p c (branch (a2)), they will conclude 
that their choice was beneficial for avoiding infection that season. An head that decides not to vaccinate 
themselves and their family (branch (b)) will judge their choice based on how many of their family members 
were infected. If k members get infected (branch (bk)), they will conclude that vaccination was necessary 
only for k members of the family. 
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Figure 5: Coverage dynamics (p) for different public heath programs in a population of N = 10 5 non- 
communicating selfish individuals using a memory parameter s = 0.7, a critical coverage p c = 0.6, and a 
probability q(0) = 0.8 of getting infected when the coverage p = 0. A: The head of the family makes the 
decision as to whether or not their family vaccinates. The coverage dynamics when the family size is eight 
(C = 8) is shown in black; the coverage dynamics when individuals make vaccination decisions independently 
is shown in gray for comparison. Similar results were obtained for family sizes of two and four. B: Individuals 
that pay for one vaccination are rewarded y = 3 extra years of vaccination; the coverage dynamics is shown 
in black and the time averages of the epidemiological quantifiers are ameliorated. The coverage dynamics 
when individuals pay for every year of vaccination is shown in gray for comparison. 




Figure 6: Bifurcation diagram of the dynamical system given by Eqs. JHBJ, (EH, and (jSHJ versus p c . s = 0.7 
and the probability of getting infected when the coverage p = is q(0) = 0.8. We slightly modified the map 
to reduce the effects of numerical noise; in turn, this slightly changes the bifurcation. 
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A 



In order to calculate the probability of getting infected with influenza q given a certain vaccination coverage 
p during one vaccination season we make the following assumptions: 

1. We ignore the inflow and outflow of individuals in the study population during a season. That is, we 
ignore vital dynamics. 

2. Individuals may vaccinate against influenza only before the beginning of the influenza season. 

3. Vaccinated individuals are not susceptible during the next coming season. 

4. Individuals who get infected and then recover remain immune to infection until the end of the season. 

As a result of the above assumptions we choose to model the epidemic transmission during one season using 
a SIR model without vital dynamics that includes vaccination at the beginning of each influenza season. 



where S(t), I(t), R(t) and V(t) represent the number of susceptible, infected, recovered and vaccinated 
individuals, respectively. The total number of individuals N — S(t) + I(t) + R(t) + V(t) is constant. f3 
represents the transmissibility in the mass-action term |21| . 7 represents the recovery rate. The probability 
of getting infected during an influenza season q(p) is given by 



where T represents the duration of the influenza season. The initial conditions are as follows. A fraction p 
of the population vaccinates against influenza leaving only (1 — p)N susceptibles. Thus, at the start of the 
influenza season, S(0) = (1 - p)N - 1, 1(0) = 1, R(0) = and V(0) = pN. In Fig. □ we show a illustrative 
graph of q(p). We note that the featured dependence is approximately piecewise linear. The discontinuity 
in derivative occurs at p = p c = 1 — 1/N — j/(3 which for large N becomes j? c «l — 7//3pQ. 



dS(t)/dt 
dl(t)/dt 
dR(t)/dt 
dV(t)/dt 



-/3S(t)I(t)/N, 
(3S(t)I(t)/N - 7 /(t) 

7'(*). 







(47) 




(48) 
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Figure 7: The probability of getting infected q(p) versus the vaccination coverage p for the SIR model with 
no vital dynamics. The parameters are N = 10 5 , = 5/6 day -1 , 7 = 1/3 day -1 and T = 200 days. 
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